Section: New Software and Platforms

MIXCAM Platform

Figure 4. MIXCAM is a multiple-camera multiple-PC hardware/software platform that combines high-resolution color (RGB) cameras with low-resolution time-of-flight (TOF) cameras. The cameras are arranged in TOF-stereo “units", where each unit is composed of two RGB cameras and one TOF camera. Currently the system is composed of four such units, or a total of eight RGB and four TOF cameras. In 2015 we completed algorithms and software packages for the calibration if individual TOF cameras [3] and of the while system composed of four units, e.g. left image, [24] . The system allows high-resolution reconstruction of people, e.g. right image, [23] .

Functional Description

We developed a multiple camera platform composed of both high-definition color cameras and low-resolution depth cameras. This platform combines the advantages of the two camera types. On one side, depth (time-of-flight) cameras provide coarse low-resolution 3D scene information. On the other side, depth and color cameras can be combined such as to provide high-resolution 3D scene reconstruction and high-quality rendering of textured surfaces. The software package developed during the period 2011-2015 contains the calibration of TOF cameras, alignment between TOF and color cameras, TOF-stereo fusion, and image-based rendering. These software developments were performed in collaboration with the Samsung Advanced Institute of Technology, Seoul, Korea. The multi-camera platform and the basic software modules are products of 4D Views Solutions SAS, a start-up company issued from the PERCEPTION group.

• Participants: Quentin Pelorson, Georgios Evangelidis, Soraya Arias, Radu Horaud.

• Contact: Radu Horaud

• URL: https://team.inria.fr/perception/mixcam-project/